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REGULATING USAGE OF COMPUTER RESOURCES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application claims the priority of United States Provisional Patent Application 
No. 60/097,912, filed August 26, 1998. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to networks, and more particularly, to a 
method for regulating the usage of resources in such networks. 

Networks, such as local area networks (LANs), are used for interconnecting many 
different devices, such as computers and peripherals, to allow users to communicate with one 
another. Further, these networks are used to allow users to share access to the connected 
peripherals. The LAN may be a heterogeneous LAN in which many different 
communication protocols are carried on a single Ethernet or token-ring medium. Examples 
of different protocols are IPX, which is typically used by DOS-based PCs and UDP/IP, 
which is typically used by UNIX-based work stations. Each type of device may be adapted 
through software to communicate using multiple different protocols. 

A peripheral also can include software. The software is in the form of multiple 

protocol stack modules that allow the peripheral to communicate using multiple protocols in 

order to be shared on a heterogeneous LAN. A protocol stack is a software module that 

processes packets of data which are received from or transmitted to the LAN using the 

corresponding protocol The protocol stacks in the associated lower-level software for 
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network communications are typically stored and executed on a network interface device that 
may be embedded in or attached to the peripheral. The network interface device serves as an 
interface which allows the peripheral to communicate with other network devices via the 
LAN. 

Due to the large number of users and devices associated with the LAN, various 
potentially unrelated devices {e.g., spawned by separate applications) compete for finite 
system resources, such as memory allocation space, disk access, and processor time. A 
device typically requests usage of a resource from the system's operating system. If the 
resource is not being used, the operating system grants access. In some networking 
environments, the device is allowed to use and hold the resource indefinitely. This can block 
other processes access to the same resource. This results in delays in or a potential 
catastrophic failure of the system. This may occur, for example, when one device is more 
important and/or urgent than another. For example, the industrial process control of a 
nuclear reactor may be more important than down loading information from the Internet. 

Many techniques have been developed to regulate computer resource usage in a 
network system. For example, a maximum time limit for the usage of a given resource may 
be used. One drawback to this technique is that a specific device may require more than the 
specific maximum time limit to execute a specific resource. 

Another known technique is to fix a process time that is substantially the same for 
each resource. Again, this technique has certain drawbacks that include not allowing a 
process to execute a resource for an extended period of time to perform an important 
function. 
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SUMMARY OF THE INVENTION 

In general, in one aspect, the invention is directed to a method of managing usage in a 

network system that includes indicating available credit for usage of a resource, and 

regulating usage of the resource by a process based on the indicated available credit. 

5 Implementations of the invention include one or more of the following. The resource 

may be a memory space or system processor time. The network may be an embedded 

computer system, or may operate in a real-time networking environment. The method may 

be modeled as a leaky bucket. The available credit may be modified by adjusting a 

maximum resource usage value of the resource. A message may be sent to a process waiting 

M to use a resource when the available credit exceeds a specified amount. 

5 In another aspect, the invention is directed to a method of managing a plurality of 

h resources in a network having a plurality of devices that includes creating a software tool 

Hi corresponding to each of the plurality of resources on each of the plurality of devices 

2 accessing the plurality of resources . The software tool may be used to regulate the usage of 

lljj any of the plurality of resources by any of the plurality of devices. 

S Implementations of the invention include one or more of the following, A descriptor 

representative of any of the software tools may be allocated to any of the plurality of 

devices. Each software tool may be associated with a maximum usage level The maximum 

usage level of the software tool may be decremented in response to the use of the resource 

20 associated with the tool by any of the devices. An available credit based on the usage of the 

resource associated with the tool may be calculated as a function of the maximum usage 

level A device waiting to use the resource associated with the tool can be informed of the 

available credit. A message may be sent to a network address associated with the waiting 

device to indicate when the available credit exceeds a specified usage level The maximum 
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usage level may be incremented to at least correspond to the specified usage level. The 
maximum usage level may be overridden to allow a device access to one of the resources. 
The software tool may be destroyed in response to a request from one of the devices. 

In yet another aspect, the invention is directed to a network including a plurality of 
devices having a plurality of resources running in the network. The network may include 
computer software residing on a computer readable medium at each device accessing the 
plurality of resources that cause the device to indicate available credit for usage of one of the 
resources, and regulates the usage of the resource by a device based on the indicated 
available credit. 

Other advantages will be come apparent from the following description including the 
drawings and the claims. 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 is a block diagram of an exemplary network system. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A common problem in a network system is that certain resources, such as memory, 
are substantially consumed by devices, such as computers, connected to the network system. 
This causes other devices connected to the system to delay executing the same process. 
Thus, urgent/important processes are unable to be accessed by these devices. This is because 
the computer system has a limited number of finite resources. After a threshold of these 
resources has been reached, the entire system can fail. 
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Accordingly, the present inventor has discovered a method that can control access to 
resources in a network system in an optimal manner. The preferred method includes a 
software tool that can be programmed into a device connected to the system. In accordance 
with the preferred method, the software tool can be used to model a resource of the network. 
The software tool which will be referred to as a "leaky bucket" and may have a hole in its 
bottom. In accordance with the preferred method, this bucket may have three characteristics. 
First, water may be poured into the bucket. However, the bucket will become full if too 
much water is poured into the bucket. Second, water may flow out of the hole in the bottom 
of the bucket at a constant rate. Thus, water may be poured into the bucket at this constant 
rate. Finally, if the bucket is not full of water, additional water may be poured into the 
bucket at a rate that is higher than the rate at which water flows out of the hole. However, 
the size of the bucket sets a maximum value for the amount of water that can be added into 
the bucket. 

The network system may be an embedded system. An embedded system is a special 
purpose networking environment in which all processes cooperate to achieve a common goal. 
Certain examples of such a system include a network router, a telephone switch, and an 
industrial control system. Preferably, the software tool is accessible through a programming 
interface. Further, the software tool is an abstract object. This means that the software tool 
is not directly associated with a queue or any other object in the system. 

The preferred method for allocating computer resources in a network is a software 
tool that a programmer may explicitly set-up and use when writing code for a particular 
device connected to the network, such as a network switch, a computer, or other similar 
network device. Alternatively, the manufacturer of an embedded system could implement, as 
a standard programming practice, that all of the programmers use the preferred method for 
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accessing specific resources in a specific manner. In the preferred method, the leaky bucket 
is created for each resource. The preferred method may be programmed in a suitable 
programming language, such as C, C++, Ada, Pascal, Fortran, Java, or assembly language. 
Examples of resources that can be regulated include memory, disk access, and system 
5 process time. 

FIG. 1 illustrates a block diagram of an example network in which the preferred 
method may be used. The preferred method may also be used in any real-time networking 
environment. FIG. 1 illustrates a LAN 10 as an Ethernet medium that has a bus-type 
architecture. A token-ring medium having a ring-type architecture can also be used. 
Connected to the LAN 1 0 is a personal computer (PC) 20 which may serve as a system 
Jl administrator's computer, a PC 30 which can serve as a print server for printers 85 and 95 

and workstations 60. The workstations 60 is any general purpose or dedicated computer 
W including PCs, Apples, Unix, and other computer workstations that can run an operating 

^ system. For example, the operating system may be a windows-based operating system. A 

fl file server 70 may allow shared access to a network disk 75 and a network expansion 

% board 100 can permit shared access to a printer 105. A network expansion device 120 may 

provide shared access to a printer 122. In addition, a network interface 125 can allow shared 
access to a copier 1 16 via a multiple device controller 130. 

In operation, the workstations 60 may access resources from other devices connected 
20 to the LAN 10. In some cases, multiple workstations 60 will attempt to access resources 

from the connected devices. However, if a number of stations 60 attempt to access the same 
resource, such as a server or another computer attached to the network, the resources in the 
server or computer may not be sufficient to accommodate all the requests from the multiple 
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workstations 60. Further, a single workstation 60 may be able to acquire all the resources in 
the server. This means that no resources will be available for the other workstations 60. 

An example of a programming interface in accordance with the preferred method is 
as follows. This example is set forth in detail in Appendix A and incorporated herein by 
reference. A simplification of the example described in Appendix A follows. The leaky 
bucket may be created by a programmer or embedded in a system by executing the following 
routine CreateLeakyBucket. In accordance with the preferred method, the 
CreateLeakyBucket function may be invoked when a work station 60 is initialized or at some 
other time while the station 60 is connected to the network. 



t__retum /*RET 

CreateLeakyBucket( 

t Jeakyjbucket *pBucket, /*IN 

dword c, /*IN 

dword m, /*IN 

dword t) /*IN 



Error code */ 

Address of leaky bucket descriptor */ 
Drain amount every t jxs */ 
Fill Level maximum */ 
Time in \is between drains */ 



A leaky bucket descriptor having the above form t_leaky_bucket may be allocated by 
the station 60 that invokes the CreateLeakyBucket routine. The descriptor may be stored in a 
memory of the workstation 60. 

In the preferred method, each leaky bucket has a "Fill Level". A Fill Level may be 
defined as a current usage of a resource controlled by the leaky bucket. When a programmer 
uses the bucket, a numerical value representing the desired amount of resource usage is 
added to the Fill Level. After a pre-defined period, for example, t microseconds, a value "c" 



PATENT 

Attorney's Docket No. 099 1 8-024001 
is subtracted from the Fill Level. The value c may be defined as an estimate of how much of 
a resource is available (i.e., not being used by another process) every t microseconds. 
Preferably, the Fill Level does not fall below zero. 

The bucket size "m" is the maximum allowed Fill Level in the bucket. The difference 
5 between the maximum Fill Level and a current Fill Level is called the "credit". 

The following functions may also be implemented for configuring the leaky bucket in 
accordance with the preferred method: 



ModifyLeakyBucket 

1^ ModifyLeakyBucket modifies the parameters m, t, c of a leaky bucket created by 

CJ calling the routine CreateLeakyBucket Preferably, the current Fill Level in the leaky bucket 

M is not changed during this routine. The current Fill Level may also not change for a current 

W Fill Level that is greater than the maximum Fill Level m. 

l|>5 tjreturn 
Ji ModifyLeakyBucket( 

t_leaky_bucket *pBucket, 

dword c, 

dword m, 

20 dword t) 



/*RET Error code*/ 

/*IN Address of leaky bucket descriptor */ 

/*IN Drain amount every t jxs */ 

/*IN Fill level maximum (max. credit) */ 

/*IN Time in jus between drains (frequency) */ 
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CreditLeft 

CreditLeft returns the remaining credit to the station 60 using a specified leaky 
bucket. This routine permits a requesting station 60 to determine if the leaky bucket has an 
adequate Fill Level to execute the requested resource. 

sdword /*RET Credit left */ 

CreditLeft( 

t_leaky_bucket *pBucket; /*IN Address of leaky bucket descriptor */ 
UseLeakyBucket 

UseLeakyBucket increments the Fill Level on a specified leaky bucket by a specified 
amount. This route returns TRUE if the Fill Level can be incremented without the bucket 
overflowing. This means that a station 60 can access the requested resource. If the available 
credit is less than AMOUNT, the requested usage of a resource by a station 60, or if another 
station 60 is waiting to use the requested resource, the Fill Level is not incremented, and the 
function returns FALSE. This means that a requesting station 60 is generally unable to use 
the resource until some later time, when enough credit is available to handle the request from 
the station 60. 
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bool /*RET 
UseLeakyBucket( 

tjeakyjnicket *pBucket, /*IN 

dword amount, /*IN 

dword maxi, /*IN 
*/ 

tjeakyj)ucket_request *pmsgReq); /*IN 



Success */ 

Address of leaky bucket descriptor */ 
Usage amount */ 

Alternative maximum (or 0 for default) 
Leaky bucket request message */ 



maxi and pmsqReq 

1ft If a station 60 using the leaky bucket discovers that the requested usage of resources 

y is not available, the station can attempt to use the resource at some later time. Alternatively, 

£ it can use a different resource. The station may also request the leaky bucket mechanism to 

W inform it when the resources are available. In this case, the operating system of the network 

1. can be instructed to call the routine pmsgReq. This causes a message to be sent to the 

; "3 

ijf: requesting station 60 when the requested usage is available. 

J>; For example, the argument pmsqReq of t_leaky_bucket_request*pmsgReq may be 

NULL to indicate no message should be sent or the network address of a station 60. For a 
specified network address, the notification message will be sent to the station 60 when the 
desired credit is available. Before this message is sent, the Fill Level is preferably 
20 incremented by at least the amount needed to satisfy the amount of the requested usage. 

The parameter maxi may be assigned to a numerical value to specify a maximum Fill 
Level to be used greater than the value m specified when the leaky bucket was initially 
created. This can be used when a station 60 requests usage of a resource that would exceed 
the limits c, t, m of the system. For example, if the resource is important or has a high 
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priority level, maxi may be set to a high numerical value to override the initial maximum Fill 
Level m. This allows an important or critical process, such as in a nuclear reactor system, to 
access a resource for a greater period of time to execute the process. If the process is not 
important, the value of m is set to logical zero (0). Accordingly, using maxi can vary the 
credit available for requested resource. 

DestroyLeakyBucket 

DestroyLeakyBucket prevents a timer t from further decrementing the Fill Level. 
After this function has been called, there will be no external references to the leaky bucket, 
and the memory previously occupied by the leaky bucket descriptor t Jeaky_bucket initiated 
by calling CreateLeakyBucket may be used for other purposes by the station 60. 

void 

DestoryLeakyBucket( 

t Jeakyjbucket *pBucket; /*IN Address of leaky bucket descriptor */ 

The following function is an example using the above software tool in accordance 
with the preferred method. This example uses a leaky bucket with a leaky bucket descriptor 
&Bucket to allocate the usage of memory in the network system. If the memory can be 
allocated, as determined by the above UseLeakyBucket routine, the memory is allocated and 
the function returns OK to indicate that the memory can be allocated. If the leaky bucket 
does not have enough credit to satisfy the requested usage, the memory is not allocated and 
the function returns NO__CREDIT. 
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t jreturn /*RET Error code */ 

allocate_memory( 



int size, /*IN Size of memory to allocate */ 

void **address) /*OUT Address of allocated memory */ 

{ 

if (!UseLeakyBucket (&bucket, size, 0, NULL)) 
return NO_CREDIT; 

else { 

^address = malloc(size); /* This is the actual memory allocation */ 

return OK; 

} 

} 

The preferred method can be used in real-time environments including industrial 
process control, weapons systems, network interfaces, and the distribution of power between 
computation intensive tasks. The preferred method can also be used in a general purpose 
computing environment. 

The preferred method uses a leaky bucket mechanism to enforce voluntary restraint 
on usage of resources by competing processes. This is a power tool for designers of 
embedded systems to regulate the usage of resources in an efficient and flexible manner. 
Further, the preferred method gives programmers the flexibility to request additional usage 
time for important process request or even to disregard this limitation. Thus, resources can 
be allocated in a specified manner to favor use for more important processes. 
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The methods and mechanisms described here are not limited to any particular 
hardware or software configuration, or to any particular communications modality, but rather 
they may find applicability in any communications or computer network environment. 

The techniques described here may be implemented in hardware or software, or a 
combination of the two. Preferably, the techniques are implemented in computer programs 
executing one or more programmable computers that each includes a processor, a storage 
medium readable by the processor (including volatile and non-volatile memory and/or 
storage elements), and suitable input and output devices. The programmable computers may 
be either general-purpose computers or special-purpose, embedded systems. In either case, 
program code is applied to data entered with or received from an input device to perform the 
functions described and to generate output information. The output information is applied to 
one or more output devices. 

Each program is preferably implemented in a high level procedural or object-oriented 
programming language to communicate with a computer system. However, the programs 
can be implemented in assembly or machine language, if desired. In any case, the language 
may be a compiled or interpreted language. 

Each such computer program is preferably stored on a storage medium or device 
(e.g., CD-ROM, hard disk, magnetic diskette, or memory chip) that is readable by a general 
or special purpose programmable computer for configuring and operating the computer when 
the storage medium or device is read by the computer to perform the procedures described. 
The system also may be implemented as a computer-readable storage medium, configured 
with a computer program, where the storage medium so configured causes a computer to 
operate in a specific and predefined manner. 
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A number of embodiments of the present invention have been described. 
Nevertheless, it will be understood that various modifications may be made without 
departing from the spirit and scope of the invention. Accordingly, other embodiments are 
within the scope of the following claims. 
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What is claimed is: 

1 LA method of managing usage of a resource in a network system, the method 

2 comprising: 

3 indicating available credit for usage of a resource; and 

4 regulating usage of the resource by a process based on the indicated available credit. 
5 

1 2. The method of claim 1 , wherein the resource is memory space or system 

2 processor time. 

j 3. The method of claim 1 , wherein the network is an embedded computer 

% system. 

% 4. The method of claim 1 , wherein the network operates in a real-time 

% networking environment. 

f| 5. The method of claim 1, wherein the method is modeled as a leaky bucket. 

j 6. The method of claim 1 , further comprising: 

2 determining the priority of the resource; and 

3 allocating the resource in response to an increased priority of the resource. 

1 7. The method of claim 1 , wherein the regulating step comprises modifying the 

2 available credit by adjusting a maximum resource usage value. 

1 8. The method of claim 1, further comprising notifying the process of the 

2 availability of the credit if the indicated available credit is less than a requested usage amount 
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1 9. The method of claim 8, wherein the notifying step comprises sending a 

2 message to a network address associated with the process when the requested usage amount 

3 is greater than the available credit. 

1 1 0. A method of managing a plurality of resources in a network having a plurality 

2 of devices, comprising: 

3 creating a software tool on each of the plurality of devices accessing the plurality of 

4 resources corresponding to each of the resources; and 

5 using the software tool to regulate the usage of any of the plurality of the resources by 

6 any of the plurality of devices. 

% 11. The method of claim 1 0, wherein the creating step comprises : 

% allocating a descriptor representative of any of the software tools to any of the 

5f plurality of devices; and 

d associating with each software tool a maximum usage level. 

HI 12. The method of claim 11, wherein the using step comprises: 

'# decrementing the maximum usage level of the software tool in response to the use of 

3 the resource associated with the tool by any of the plurality of devices; 

4 calculating an available credit based on the usage of the resource associated with the 

5 tool as a function of the maximum usage level; and 

6 indicating to a device waiting to use the resource associated with the tool of the 

7 available credit. 

1 13. The method of claim 12, wherein the indicating step comprises sending a 

2 message to a network address associated with the waiting device to indicate when the 

3 available credit exceeds a specified usage level. 
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1 14. The method of claim 13, further comprising incrementing the maximum usage 

2 level to at least correspond to the specified usage level 

1 15. The method of claim 1 1, further comprising overriding the maximum usage 

2 level to allow a device access to one of the plurality of resources. 

1 1 6. The method of claim 1 0, further comprising destroying the software tool in 

2 response to a request from one of the devices. 

1 17. Computer software, residing on a computer-readable medium at a device 

2 connected to a network, comprising instructions to cause the device to perform the following 
ffi operations: 

W indicating available credit for usage of a resource; and 

|l regulating usage of the resource by a process based on the indicated available credit. 

T 18. A network including a plurality of devices, comprising: 

H a plurality of resources running in the network; and 

ifi- computer software, residing on a computer readable medium at each device accessing 

# the plurality of resources to cause the device to perform the following operations: 

5 indicating available credit for usage of a resource; and 

6 regulating usage of the resource by a process based on the indicated available 

7 credit. 

1 19. The method of claim 18, wherein the plurality of resources comprise memory 

2 space or system processor time. 

1 20. The method of claim 1 8, wherein the network is an embedded computer 

2 system. 
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1 21. The method of claim 1 8, wherein the network operates in a real-time 

2 networking environment. 
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ABSTRACT OF THE INVENTION 

A method is described that can be used to regulate the usage of resources in a network 
system. A software tool can be used to regulate access to a system resource. The preferred 
method uses a software tool to enforce voluntary restraint on the uses of resources by 
competing processes. Further, the software tool can be used to request additional usage time 
for more important or sensitive processes requesting a specific resource. The preferred 
method can be used with a general computing environment or in an embedded system. 

113120.doc 



-19- 





■7r 



ft 



■IV 



■4 



O 

si 
w 

S3 

y 
ru 

s 

o. 
03 
fy. 
ffl 

41 




/0 




/Crt» 





Attorney's Docket No. 09918-024001 



COMBINED DECLARATION AND POWER OF ATTORNEY 
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I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and 
joint inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is 
sought on the invention entitled REGULATING USAGE OF COMPUTER RESOURCES , the specification of 
which: 

[] is attached hereto. 

[X] was filed on August 26, 1999 as Application Serial No. _ and was amended on 
[] was described and claimed in PCT International Application No. filed on _ and as amended under 
PCT Article 19 on 

I hereby state that I have reviewed and understand the contents of the above-identified specification, 
including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose all information I know to be material to patentability in accordance with 
Title 37, Code of Federal Regulations, §1.56. 

I hereby claim the benefit under Title 35, United States Code, §1 19(e)(1) of any United States provisional 
application(s) listed below: 

U.S. Serial No. Filing Date Status 

60/097,912 August 26, 1998 Pending 

I hereby claim the benefit under Title 35, United States Code, §120 of any United States application(s) 
listed below and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior 
United States application in the manner provided by the first paragraph of Title 35, United States Code, § 1 12, 1 
acknowledge the duty to disclose all information I know to be material to patentability as defined in Title 37, Code 
of Federal Regulations, § 1.56(a) which became available between the filing date of the prior application and the 
national or PCT international filing date of this application: 

U.S. Serial No. Filing Date Status 



I hereby claim foreign priority benefits under Title 35, United States Code, §119 of any foreign 
applications) for patent or inventor's certificate or of any PCT international application(s) designating at least one 
country other than the United States of America listed below and have also identified below any foreign application 
for patent or inventor's certificate or any PCT international application^) designating at least one country other than 
the United States of America filed by me on the same subject matter having a filing date before that of the 
application(s) of which priority is claimed: 

Country Application No. Filing Date Priority Claimed 

[]Yes []No 

[] Yes [] No 
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Richard P. Ferrera, Reg. No. 30,632; Richard J. Anderson, Reg. No. 36,732; Joseph R. Baker, Reg. No. 
40,900; Ingrid Beattie, Reg. No. 42,306; Robert M. Bedgood, Reg. No. 43,488; Mark S. Ellinger, Reg. No. 
34,812; J. Eldora L. Ellison, Reg. No. 39, 967; Peter Fasse, Reg. No. 32,983; J. Patrick Finn, III, Reg. No. 
44109; Harold Fox, Reg. No. 41,498; Janis K. Fraser, Reg. No. 34,819; John W. Freeman, Reg. No. 
29,066; Diane L. Gardner, Reg. No. 36,518; Scott Harris, Reg. No. 32,030; John F. Hayden, Reg. No. 
37,640; George Heibel, 42,648; John Land, Reg. No. 29,554; Ronald C. Lundquist, Reg. No. 37,875; Anita 
L. Meiklejohn, Reg. No. 35,283; Reginald Suyat, Reg. No. 28,172; Y. Rocky Tsao, Reg. No. 34,054; Hans 
R. Troesch, Reg. No. 36,950; John R. Wetherell, Jr., Reg. No. 31,678; Dorothy P. Whelan, Reg. No. 
33,814, of FISH & RICHARDSON P.C. 



Address all telephone calls to Richard P. Ferrara at telephone number 212/765-5070. 

Address all correspondence to Richard P. Ferrara at: 

FISH & RICHARDSON P.C. 
45 Rockefeller Plaza, Suite 2800 
New York, NY 10111 



I hereby declare that all statements made herein of my own knowledge are true and that all statements 
made on information and belief are believed to be true; and further that these statements were made with the 
knowledge that willful false statements and the like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such willful false statements may jeopardize the validity 
of the application or any patents issued thereon. 



Full Name of Inventor: 

Inventor's Signature: 
Residence Address: 
Citizenship: 
Post Office Address: 



CLAUS TONDERING 



Lyngby, DENMARK 
Denmark 
Skowaenget 16 
Lyngby 

DENMARK-2800 



